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X> '. Abstract 
CD . 

The misalignment mechanism for axion production depends on the temperature-dependent axion 
mass. The latter has recently been determined within the interacting instanton liquid model 
(IILM), and provides for the first time a well-motivated axion mass for all temperatures. We 
reexamine the constraints placed on the axion parameter space in the light of this new mass 
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10 11 GeV or m a > 21(±2) ueV from the misalignment mechanism in the classic axion window 
(thermal scenario). However, this is superseded by axion string radiation which leads to f a < 
3.2^2 x 10 10 GeV or m a > 0.20^q'| meV. In this analysis, we take care to precisely compute 

cn 

J> ' the effective degrees of freedom and, to fill a gap in the literature, we present accurate fitting 

formulas. We solve the evolution equations exactly, and find that analytic results used to date 

O 

generally underestimate the full numerical solution by a factor 2 — 3. In the inflationary scenario, 
axions induce isocurvature fluctuations and constrain the allowed inflationary scale Hj. Taking 
anharmonic effects into account, we show that these bounds are actually weaker than previously 



computed. Considering the fine-tuning issue of the misalignment angle in the whole of the anthropic 



window, we derive new bounds which open up the inflationary window near 9 a — > tt. In particular, 
we find that inflationary dark matter axions can have masses as high as 0.01-1 meV, covering the 
whole thermal axion range, with values of Hj up to 10 9 GeV. Quantum fluctuations during inflation 
exclude dominant dark matter axions with masses above m a < lmeV. 
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I. INTRODUCTION 



Axions are still one of the best motivated cold dark matter candidates. Initially invented 
to solve the strong CP problem ("why is the QCD vacuum angle so so small?", i.e. 9 < 



10 9 ), it was soon realised by Weinberg 
mechanism 



and Wilczek 



64 



that the Peccei-Quinn (PQ) 



65| gave rise to a very-light pseudo-scalar Goldstone boson. In order to 



retain renormalisability, Peccei and Quinn introduced a new chiral symmetry, U(1)pq, on 
the quark and Higgs fields, that is spontaneously broken. This implies the existence of 
a new particle, a would-be pseudo- Goldstone boson, the axion; it receives a mass due to 
instantons because U(1)pq is anomalous. In the original papers, the axion was incorporated 



in the electroweak sector but laboratory experiments soon ruled out such a, 
GeV coupling. This gave rise to the so-called invisible axion models 
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priori are not tied to any known energy scale. To constrain them, it was realised that such 
extremely weakly interacting particles could provide a new cooling mechanism for stars. The 
invisible axions have typically very weak couplings to ordinary matter. On the one hand, 
this makes their experimental detection difficult but, on the other hand, provides us with a 
well- motivated dark matter candidate. Refer to past reviews 
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491, for further details. 



The axion has a rich phenomenology in that it can be produced thermally or non- 
thermally. The thermal production channel is the standard scenario for most WIMP's 52]. 
Recently it was shown that the thermal axion cannot contribute the dominant dark matter 
component of the universe 43I] 1 . The axion can also be produced non-thermally: after the 
spontaneous breaking of the PQ symmetry, the axion lives in a U(V) vacuum manifold; such 
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44|, whose ra- 



a broken field supports the formation of topological strings 
diation produce axions. Finally, axions can be produced non-thermally through the so-called 
misalignment mechanism: at the QCD phase transition non-perturbative effects generate a 
mass, and the axion field relaxes to its minimum, which is precisely the PQ mechanism 2 , 
invented to solve the strong CP problem. The oscillation around its minimum produce a co- 



herent state of zero mode axions, i.e. a Bose-Einstein condensate 72(. This last production 



15 eV. This 



1 The thermal axion bound follows from (m„ /130 eV) < fl c g* ec /10, and is saturated for 
bound is, however, excluded by the new astrophysics bound m a < 0.01 eV. Thus, Clf = fi c (0.01/15) « 
0.001 fi c . 

2 The angle, a free parameter, is replaced by a dynamical field that evolves to its CP-conserving minimum. 
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scenario is potentially sensitive to the QCD effects, i.e. the axion mass, and is the primary 
subject of this paper. 

Because of the anomalous Uj>q(1) symmetry, the axion has a two gauge boson interaction 
and can thus decay into two photons; such processes are used to look for axions experi- 
mentally, e.g. in solar axion searches and vacuum birefringence experiments. The former is 
one of the more stringent astrophysical constraints, the strongest coming from the analysis 
of the supernova 1987A neutrino flux which would be affected by axions. It gives a lower 
bound for the axion decay constant, /„ > 10 9 GeV. See [54( for a recent, comprehensive set 
of review articles. 

In section [TT] we briefly review the strong CP problem and the PQ mechanism that lead 
to the introduction of the axion. We continue to discuss the effective axion potential in 
section IHH and essentially focus on the temperature dependent axion mass. We review our 
determination of the mass in the framework of the interacting instanton liquid model (IILM) 
. In section HVl we reexamine the cosmology of the vacuum realignment production mode 



in light of this new mass function: We solve the cosmological evolution equations numerically, 
and compare the results to the standard analytic approximation, identifying regimes in which 
present estimates are and are not robust. To make the numerics self-contained, we include 
the correct effective degrees of freedom for the entropy and radiation density and provide 
accurate fitting formulas for their rapid evaluation in appendix [K\ For completeness, we 
also review and update constraints from axion string radiation. 



II. STRONG CP PROBLEM AND PECCEI QUINN MECHANISM 

The Lagrangian of QCD takes the form 

Cqcd = -\F%F a ^ + - M)ip , (1) 

where ip carries flavour and colour indices, M is the mass matrix and is the covariant 
derivative in the fundamental representation. If M — this Lagrangian has a U{Np) l <8> 
U(Nf)r symmetry. It turns out that the subgroup SU(Nf)l <8> SU(Nf)r is spontaneously 
broken down to the vector SU(Np) symmetry; the Goldstone bosons that accompany the 
spontaneous symmetry breaking are identified with the light pseudo scalar octet. 

Of the remaining phases U(l)y®U (1)a, the former is conserved through gauge invariance, 
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while the latter is anomalous, i.e. is not a symmetry at the quantum level. This fo 



66|. 



lows from 



the topologically non-trivial nature of QCD and the famous triangle anomaly 

The topologically non-trivial field space leads to the so-called n-vacua, i.e. vacua that 
belong to different topological equivalence classes labelled by a winding number or Chern- 
Simons charge. The n-vacua change their winding under large gauge transformations, |n) — > 
|n+m) for gauge transformations in the m-sector. The winding for the gauge transformation 
is different from the winding of the n-vacua; they are, of course, related in that the winding 
number for the non-vacuum field configurations is given by the divergence of the Chern- 
Simons current. Thus to construct a gauge invariant vacuum, we need a superposition of 
the n-vacua, and we arrive at the 6*-vacua 



|0) = J2e Wn \n). (2) 



Due to a superselection rule, different values of 9 correspond to different theories. Summing 
the partition function over all topological sectors introduces a new term into the action, and 
the Lagrangian becomes 



The 9 term vio 



C^C + 9^- 2 F; v F^ . (3) 

ates P and CP unless 9 = or 9 = 7r. It gives an electric dipole moment to 
the neutron {§[ 2l|, which is tightly constrained experimentally {t| and results in the bound 

9 < 1(T 9 . (4) 

A priori, we could just demand that the QCD Lagrangian be CP symmetric. However, 
in the Standard Model of particle physics the electro-weak sector contributes to the vacuum 
angle through the phase of the quark mass matrix; the weak CP non-invariance is well ac- 
commodated for by the CKM-matrix, and thus by explicit CP breaking. Therefore, it would 
be rather unnatural to postulate a CP invariant QCD Lagrangian, and CP is presumably 
also broken explicitly in the strong sector. 

The strong CP problem relates to explaining the smallness of the 9 angle. A solution 
within QCD is given if at least one quark is massless. In such a case, the massless quark can 
be chirally rotated by 9 which, through the anomaly, removes the 9 term altogether from the 
Lagrangian. Hence, the 9 parameter is not physical. However, the assumption of a massless 
quark doesn't comply to experimental observations combined with predictions from chiral 
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perturbation theory 3 , see for instance 841 ]. 

All models have the generic feature that the axion only couples derivatively to matter 
and the only non-derivative coupling is to the topological charge 4 

-.2 
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(5) 



where <p a is the axion field and f a the axion decay constant. 

The PQ mechanism works because the effective potential for the (homogeneous) axion 
field has a CP-conserving minimum {^J 



-vv ea (</>) 



< 



[dA] det( 7 ^ t + M) e 

[dA] det(-f a D a + M) e~ 

vv aS (<t>=-f a e) 



J a 



Ao+4-)Q 



(6) 

(7) 
(8) 



and thus (9 + <f> a / f a ) = 0, where V the 4-dimensional volume. Note that the effective 
potential is periodic and that our computation is performed in the Euclidean theory. At finite 
temperature, real-time configurations, sphaleron transitions, might also give contributions. 
However, as was shown in [59}, these classical field configurations do not affect the axion 
mass at leading order, basically because the classical field equations do not depend on 9. 
Shifting the axion field, we will define 9 + <f)/f a — > 9 a , with 9 a the axion angle. Thus, the 
PQ mechanism effectively trades 9, a free parameter, for a dynamical field that evolves to 
its CP-conserving minimum. 

III. AXION POTENTIAL 



Evaluation of ([H]) allows us, in principle, to determine the axion effective potential. We can 
of course not hope to get exact, analytic formulas since the effective potential includes strong 
coupling QCD effects. Ultimately, the lattice will be able to compute the axion effective 



3 The non-zero quark mass used in chiral perturbation theory could in fact be an instanton induced 'soft' 
mass, even though the fundamental current mass is zero, see for instance the discussion in 
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5 II] - Recent 

lattice studies to determine the current quark masses seem to rule this possibility out 57 1 . 
4 If we restrict ourselves to QCD. The axial current does, however, also receive an anomaly from QED; the 
corresponding non-derivative interaction is responsible for the decay of an axion into two photons. It is 
exactly the same mechanism that explains why the neutral pion decays into two photons. 
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potential exactly. However, there are technical problems since the action is complex and 
cannot be studied directly by simple Monte Carlo methods. This is the same problem that 
arises in lattice gauge theory with a finite baryon density, i.e. a non-zero chemical potential. 

On the analytic front, progress can be made by saturating the path integral with suitable 
background configurations that are supposed to play an important role for the problem 
at hand. Since the axion couples to the topological charge, it makes sense to study the 
path integral in the background of instantons, which are the prototype topological field 
configurations in QCD. This approach was pioneered in [if], [l?]] with a strong emphasis on 
the so-called dilute gas approximation. In this limit, the partition function is saturated 
by an ensemble of non-interacting instantons, and the path integral simply factorises into 
single instanton contributions. The latter has been computed exactly, at zero [75I and finite 
temperature 36j, and is of the form (at one-loop and zero temperature) 

Z x = I dpd(p) Y[det(p + m q ), (9) 

J q=l 

a 2 \ 2Af c 

l> 5 A 6 ( ) C Nc , (10) 



b= T Ne ~l NF ' 

0.466 exp(-1.679iV c ) 
Cn < ~ (N e -l)\(N c -2)\ ■ (12) 

Note that det stands for the renormalised quark determinant; its UV contribution gives 
rise, through charge renormalisation, to the Np dependent term in d. Recently, the quark 
determinant has been computed for any value of the quark masses |27) ; in the small mass limit 
we have det(^ + m q ) — » 1.34m q p. At finite temperature, electric Debye screening prohibits 
large scale coherent field configurations to exist in the plasma, i.e. fields with a correlation 
length £ > 1/T. This changes the instanton weight by d(p) — > d(p) exp(— (2irTp) 2 ). 
Given Zx, the dilute gas approximation follows immediately as 

Z= £ nW1 Z i I+Na eMiUNi - N A )) , (13) 

where we have already included the axion angle through its non-derivative coupling to the 
topological charge, which is approximated by Q = Nj — Na in the background of Ni in- 
stantons and Na anti-instantons. This sum is easily computed, and we find the effective 
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potential 



cffl^aJ 



2 / d(p) cos 9 a 



(14) 



where we absorbed the renormalised determinant into d for notational simplicity. That the 



potential had to be periodic follows from the defining QCD path integral (EJ). In gen era 



potential will have a much more complicated form than this simple cosine, see 32 



34 



, the 
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411 ] . Still, one can estimate that the first few terms of a harmonic expansion should describe 



the axion potential rather accurately 49J, and it is custom for axion cosmology to work with 
a simple cosine. 

Note that the effective potential is negative at its CP conserving minimum. The reason is 
that the one-instanton contribution is really normalised to the perturbative result, which by 
definition has zero energy. Instantons, interpreted as tunnelling effects between the n-vacua, 
restructure the vacuum and give rise to the energetically lower true vacuum. 

At temperatures below the QCD phase transition, the dilute gas approximation breaks 
down. In that regime chiral perturbation theory can however be used to derive the classic 
result for the zero temperature axion mass 



2 £2 2 r2 

m afa = ™Jt 



m u m d 



(15) 



(m u + m d ) 2 

with corrections of order one that depend on the precise model. The above axion mass is 
exact in the framework of the simplest hadronic axion 48|, |70J] , where only a new super-heavy 
SU(2) x U(l) singlet Dirac spinor carries PQ charge; after integrating out the heavy field, 
we are left with the typical non-derivative coupling to the QCD topological charge. The 
low energy effective QCD Lagrangian, i.e. chiral perturbation theory, including the axion, 
is also used to derive the cou plin gs of axions with pions and the weak sector, needed in the 
thermal production scenario [43j. Above the phase transition these coupling follow from the 
fundamental Lagrangian 58]. 

This same result can also be derived from the defining QCD path integral by noting that 



2 r2 
m afa 



d 2 V r 



cff 



X 



(16) 



where x — li m v->oo is the topological susceptibility. It can be shown that x is related 



to the quark condensate 



55] and, using chiral perturbation theory, this can be transformed 



into f 1 1 5 p . Here, only the axion carries PQ charge and it interacts with matter derivatively, 
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together with the topological coupling to the gauge sector. This axion field is the same as 
the physical axion field in the effective Lagrangian approach, i.e. the propagation eigenstate. 

The important point to note is that the axion mass is essentially given by the topological 
susceptibility, a quantity that is routinely measured on the lattice. With the recent progress 
of lattice algorithms and increased computing power, physical quark mass simulations are 
finally feasible and the lattice will soon be able to provide us with the best estimate for the 
temperature dependent axion mass. 

In this paper we will use the interacting instanton liquid model (IILM) to study the axion 
mass; it is based on the idea that the instanton ensemble is fairly dilute but that interactions 
are nevertheless important [67| . It has been shown to give a self-consistent framework at 
zero and finite temperature |28l430||. The IILM saturates the path integral with an ansatz 
for the multi-instanton background configurations, and treats the low-frequency fluctuations 
'exactly' while still assuming a factorisation of the high frequency gluon, quark and ghost 
spectrum. The IILM partition function is defined by 

Z ^ = £ nJW7< / II WW*-** > ( 17 ) 

N It N A 2 ' A ' J i=l 

f lndet(I + ^) ,Q<0 



pairs (ij) 5=1 



lndet(I + ££) ,Q>0 



The integration is over the collective coordinates, which are the positions, sizes and the colour 
embedding matrices. The classical gluonic two-body interaction is given by V^; it receives 
a contribution from the high frequency fluctuations through charge renormalisation. The 
latter is approximated by the one- instanton action, So = 8ir/g 2 , with the running coupling 
evaluated at Jp%Pj- The low frequency quark determinant is approximated by the finite 
dimensional subspace of quasi zero modes i.e. Tja = (£i\P\£a)- 

This partition function has been used to run grand canonical Monte Carlo simulations. 
The parameters were calibrated at zero temperature and physical quark masses were deter- 



mined self-consistently 



8l|. Finite temperature simulations have been performed to compute 



the topological susceptibility 82) . In the latter paper that data was used to derive the axion 



mass. In the low temperature regime the axion mass can be approximated by 

1 + 0.50T// 
1 + (3.53 T/A) 



mlfl = 1.46 10-»A \ 1 t°i!i^ A 7 . 48 ; < T/A < 1.125 , (19) 
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where A = 400 MeV. It is displayed in Fig. Q] 

Including effects from quark thresholds, the high temperature axion is given by 

' exp [4 3) + 4 3) In I + 4 3) (In if + df (in if] , <T< 
exp 4 4) + 4 4) lnf + 4 4) (lnf) 2 ] 
exp U 5) + 4 5) In I + 4 5) (lnf) 2= 



= A 4 < 



7 1 (4) <T < 

< T < T^ 6 ) 



(20) 



and the different parameters by 
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100 



(21) 



The quark thresholds are treated within the effective field theory language, where decoupling 
is enforced by hand and continuity is achieved through matching conditions. 

We also give a very simple approximation to the dilute gas result in the form of a power- 
law, as in earlier work jfj[ Q] , 

2 a aA 4 , , 

where n = 6.68 and a = 1.68 10~ 7 , from (12 lj) : it compares well with [6]. We believe it 
is a coincidence that such a simple fit, based solely on the high temperature regime, still 
gives such a good overall approximation to the much more elaborate result of the IILM 
simulations, see Fig. [2j 

We found that the instanton ensemble is very distinct from a non-interacting system. 



Corroborating earlier ideas on the instanton liquid at finite temperature 82[, we found 
a population of instanton-anti-instanton molecules and a non- interacting remnant. The 
molecules do not lead to charge fluctuations and, hence, the axion mass is determined by 
the random sub-ensemble. It turns out that the latter have a concentration that just matches 
the dilute gas approximation. We believe this is an unfortunate coincidence; in particular, 
we have found within a toy-model that, depending on the interaction and screening effects, 
a different high temperature behaviour can occur: for stronger interactions the molecule 
concentration can become higher so that the non-interacting sub-ensemble acquires a lower 
density, and hence a lower axion mass, compared to the dilute gas estimate 



. A crude ar- 



gument within the IILM gave evidence that at higher temperatures, with more active quark 

9 
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FIG. 1: The mass for the QCD axion follows from the topological susceptibility, m^f^ = X- The 
fit goes over to the dilute gas approximation for moderately high temperatures T ~ 400 MeV, in 
accordance with the IILM data. Note that the large errors are mostly due to the large uncertainties 
in the determination of A, used to set dimensions. 

flavours, the fermionic interactions might outweigh the screening effects and the molecule 
concentration could increase. For temperatures below the charm or even the bottom thresh- 
old, the molecule concentration will, however, decrease as the screening effects dominate 
over the interactions. That the molecule concentration would not depend monotonically 
on the temperature seems unnatural. Below the charm threshold, where we find that the 
molecule density decreases, weaker screening effects could alter this trend: corrections to 
the factorised high frequency quantum interactions could indeed induce weaker screening 
because overlapping instantons have effectively a smaller size; note that at zero temperature 
such quantum interactions were estimated to be subdominant but this has not been repeated 
for the finite temperature case. 

In the pure gauge sector the IILM is not able to accurately describe the topological 
susceptibility as obtained from lattice simulations, whereas a dilute gas model of non-trivial 



holonomy calorons fared rather better 35|. In particular, the IILM predicts a topological 



susceptibility that decays too fast. These more general degrees of freedom should therefore 
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be included into the IILM in the future to improve on the quenched sector and to investigate 
whether they also lead to significant changes in the unquenched case. We might expect the 
implications to be smaller because of chiral symmetry, which is successfully implemented 
in the IILM and believed to play a crucial role in the strong dynamics. In the unquenched 
case, we don't have lattice data available to check for a qualitatively different behaviour of 
the IILM in the high temperature region. Given the progress of lattice simulations in the 
physical regime, this issue will be settled in the near future. 

Despite these uncertainties, our investigation might be evidence that the axion mass is 
fairly insensitive to the details of the instanton ensemble and that the dilute gas approxima- 
tion might prove to be a reliable estimate, even though the instanton ensemble is certainly 
not non-interacting. 



IV. AXION COSMOLOGY 



Now that we have determined the mass function for the axion, we can turn to the cos- 
mological implications. For the misalignment mechanism to produce a dominant axion 
contribution, we assume that the axion is created before the end of inflation; otherwise 
axionic string radiation will produce the bulk of the axion population Thus 
when the PQ symmetry is spontaneously broken, we have different initial angles, the mis- 
alignment angles, in the causally disconnected regions. Later, inflation sets in and stretches 
these patches to cosmological sizes such that throughout the observable universe the same 
misalignment angle prevails. Once instanton effects set in, the axion becomes massive and 
starts to oscillate. 

Only the homogeneous part of the axion field is relevant for the misalignment mechanism. 
We are interested in the regime when the axion starts rolling, which happens around the 
QCD scale when the universe is radiation dominated. Recent lattice data suggests that the 
QCD phase transition is a cross-over rather than a sharp phase transition j^J. In particular, 
it is not of first order, and no latent heat is produced. Furthermore, we assume that no exotic 
particles beyond those in the Standard Model decouple relativistically. Thus, the universe 



5 Note that there is still some controversy with regard to this statement, and other numerical work 38l |44 1 
finds the axion contribution from string radiation and decay to be comparable to the contribution from 
the vacuum realignment production mode. 
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FIG. 2: Shown are the mass for the QCD axion from IILM simulations (I19p . from a lattice inspired 



fit that uses the IILM mass shifted towards higher temperatures to mimic the 



phase transition at 



160 Me V, from the classic dilute gas approximation (DGA) by Turner 



761 ] and its update 



by Bae et al. 6J, and from the DGA derived in this paper (|22|) . The simple power-law DGA 
axion masses are cut off by hand once they exceed m a (T = 0) and give a surprisingly good 
approximation to the full IILM result; we believe this is a coincidence. The differences that persist 
to high temperatures, between the update and our DGA model, arise from the slightly different 
quark masses. Our choice has the merit that the masses were determined self-consistently within 



the IILM at T = 



fill- 
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evolves adiabatically and we leave aside models with additional entropy production, see for 
instance the discussion in jsil ]. 

Since we will also be interested in assessing the accuracy of the standard analytic results 
for the misalignment mechanism, we will take care to include the correct number of degrees 
of freedom . Following the analysis in 20j , we include all the known hadrons 6 up to a mass 
of 3 GeV in the low temperature regime, and match smoothly to the plasma phase. Using 
a rough estimate of the available lattice data sensitive to the confinement /deconfmement 



transition 



461 ] . e.g. the Polyakov loop, we will use T c = 180 MeV; given the spread in these 



results and also the cross-over nature of the transition 5], we apply the smoothing over a 
range of AT = 20 MeV. This is slightly different from 20] which used {T c = 180 MeV, AT = 
5 MeV} but the changes are small in any case. The effective degrees of freedom are given 



by 



52] 



u,h > ( ^ ) ^rr / dx / x2 + y * 7 , (23) 

exp a/x 2 + y 2 + (-1) Q » 

x 2 J x 2 + y 2 ( 1 x 2 



IT 


\ 4 1% 




1 7T 4 






T, 


/ 4tt 4 



„,s = -73T / ^ ; ( -_ 1)g; [1 + , (24) 

where T is the temperature of the plasma, T the temperature of species i, yi = rrii/Ti, and 
Q^(fermion) = 1 and Qf (boson) = 0. The full numerical integration is too slow to be used 
in other numerical investgations, such as the axion dynamics in a Friedmann-Robertson- 
Walker (FRW) universe to be discussed below. To this end, we have also determined fits 
that are accurate below the 1% level, except at the phase transition and annihilation 
where the error rises briefly to 4%. The fits are given in appendix |A] 

An adiabatically evolving universe has a specific relation between the temperature and 
the scale factor, see Fig. [3j This allows us to accurately relate cosmic time to the temperature 
of the plasma; the latter is required to evaluate the axion mass. 



A. Misalignment mechanism 

I — I 

As usual in standard cosmology, the universe will be described by a flat FRW metric |52], 
with cosmological parameters given by the concordance of the best available data (we take 

6 "with strong experimental evidence" , see Q ; we use a multiplicity of g j = 1 if the angular momentum is 
not known 
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FIG. 3: In an adiabatically evolving universe the scale factor and the temperature are related 
through the condition of constant entropy. Given the knowledge of the effective degrees of freedom 
g* t S, it amounts to solving an implicit equation. The QCD phase transition occurs at around 
Tqcd ~ 180 MeV, when the number of hadronic excitations rises very sharply, and g* t s is almost 
discontinuous; the would-be latent heat 'reheats' the universe, which is clearly seen in the graph. 



WMAP5+BAO+SN 53[). For the temperature regions of interest we can restrict ourselves 



to radiation and axions, in which case Einstein's equations are given by 

H 2 = sk O&M 1 * + fl (\C + m 2 Q (T)(l - cos0 a ))) , (25) 
+ 3H0 a + m 2 a (T) sin 6 a = , (26) 

where Mj> is the reduced Planck mass. Note that the effective axion potential has been 
shifted so that non-perturbative effects do not lead to a no n- vanishing vacuum energy 7 . 

The dynamics of the axion evolution consists of three qualitatively different stages: First, 
as long as its Compton wavelength is above the Hubble scale, the axion is effectively massless; 
the Hubble friction enforces a constant axion field in this case. Secondly, once the axion 
mass becomes comparable to the Hubble scale, at a time when m a rs 3H holds, the axion 



7 Note that there exist theories that combine another axion-like field to entangle the dark matter and the 



dark energy sector 50|, [61 1 . 
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feels the pull of its mass and starts to roll towards its minimum at 9 a = 0. Finally, after 
a few oscillations the axion evolution is indistinguishable from pressureless matter and the 
axion number per comoving volume is conserved. These three regimes are illustrated clearly 
for an explicit numerical solution in Fig. HJ 

The physics underlying the misalignment mechanism is based on the fact that the energy 
redshifts with time, and that the Hubble dilution starts once the oscillations in the axion 
zero mode begin. Consequently, the total Hubble redshift increases with m a . This leads to 
the a priori counterintuitive behaviour that light axions, i.e. high f a , contribute more to the 
energy balance than heavy axions. 

Analytical progress can be made by noting that 

^ = 2m a m a (l - cos6 a ) - 3H6 a 2 , (27) 

J a 

where we have made use of the equation of motion for the axion field (1261) . We assume that 
over one oscillation a, H and m a do not change much, i.e. adiabatic evolution. Furthermore, 
we consider times when the axion field has been Hubble redshifted for long enough so that 
anharmonic effects are negligible, in which case the axion behaves as a damped harmonic 
oscillator with constant coefficients. For such a system Q 2 a = m 2 6 2 , where the expectation 
value is an average over one oscillation. This leads to 

^- = const . (28) 
m a 

Eq. ( 1281) allows us to easily compute the energy in the axion field today 

/, , \ m a (today) s (today) 
p a (today) = p a (T)— _ (29) 

where T is the temperature when we reached the asymptotic behaviour predicted by (1281 . 
s = ^r-g^^T 3 is the entropy density and g* t s is the effective number of degrees of freedom 
shown in Fig. [5J we have neglected the overbar for simplicity. This can then be compared to 
the present critical energy density, which constrains the axion mass. Note that apart from 
the time average, a spatial averaging is implicitly understood. In the formulas that follow 
the coarse-grained 9 a now stands for the effective axion angle 

0f = Vm = y/(Oa) 2 + ol a , (30) 

where <jg a represents contributions from quantum fluctuations and classical inhomogeneities. 
(This notation for 9 a is used except where explicitly stated otherwise or in expectation 
values.). 

15 




FIG. 4: As long as the axion Compton wavelength is well outside the horizon, the axion zero 
mode is frozen; this corresponds to the late-time solution of (|26H with m a neglected. The axion 
starts to feel the pull of its mass at m a ~ 3H, and evolves to its minimum at 9 a = 0, i.e. the 
PQ mechanism to solve the strong CP problem. After a few oscillations the axion number per 
comoving volume stays constant as long as the axion mass and the scale factor change slowly 
(adiabatic approximation). This is then used to extrapolate the result to today. 
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FIG. 5: The effective degrees of freedom g* t R and g*,s are given for the temperature range up to 
T ~ 100 GeV. The decoupling of the neutrinos is included and manifests itself in the differences 
between g*^ and g*^ after annihilation, when T v / T 7 . We followed closely 20J, but included 



some minor changes to take into account a better understanding of the QCD phase transition from 
recent lattice studies (see main text). We have determined fits by using a sequence of smoothed 
step functions, see appendix [AJ As seen from the graph, the fits are good, generally with an 
accuracy below 1%. 

As alluded to in the introduction, the axions produced from the heat bath have been ruled 
out as the dominant cold dark matter contribution 43j. The remaining window for larger 



values of f a , bounded from below by astrophysical considerations, implies tiny couplings of 
axions to ordinary matter so that the axions will stay out of equilibrium with respect to 
the cosmic plasma; anharmonic effects that couple higher modes can also be ignored by the 
same reasoning. In addition, axions have very small velocity dispersions 8 . Therefore, axions 
provide a generic cold dark matter candidate, which is constrained by observation to be 



Q r < 0.23 



53]. 



The zero-mode has, by definition, none. Non-zero-mode contributions, due to inhomogeneities in the 
axion field set up during the PQ phase transition and due to string decay, can be shown to be small (see, 
for example, Sikivie's review article in [5^]). 
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We will follow the early paper 76 1 and the recent update j^] to derive an analytic formula 
for the axion abundance which we then compare to a full numerical solution (using the same 
updated parameters). We will use the simple power-law approximation (1221) for the axion 
mass from the dilute instanton gas; it reaches the T = mass at T w 100 MeV, converges to 
the full IILM mass at T « 400 MeV and overestimates it slightly for higher temperatures, 
as can be seen in Fig. [2j Note that the coefficient a a oc m u mdm s . The axion starts rolling 
at 

T™+ 4 « 0.04- T > 103 MeV (31) 

9*,RJa 
2 

T 4 « 0.04^^, T< 103 MeV. (32) 

Assuming that the number of axions per comoving volume is conserved at T a , we can use 
fl29D to get 

45s / (0.2m Pl )-^g~^ X ^- l a:^ fPe 2 a 
(0.2 m Pl )-lg-ix l ± fl 01 

Note that the axion abundance is fairly insensitive to changes in a a due to its small exponent. 
In particular, the large uncertainties in the quark masses have only a minor effect on the 
final results. We therefore expect this estimate of the energy density p a to differ only slightly 
relative to the results of [6j, say. The additional T-dependence due to g* t R and g* s will also 
be weak, again due to rather small exponents. Using A = 0.4 GeV, x = (78.2 MeV) 4 and 
T 7 = 2.725 K we get 

1.46 GeV «-° B 094 f 1 -^^) 019 



Pa 4tt 2 1 /no™„>L-i 



122 GeV ^ 



0.25 / 10 12 GeV 



and 

^ ^2 _ I °- 54 rf 41 ^a (i i/°Gov) / 35 N 

a ~\ 0.0064^ (WW)"' 
These analytic results can be improved by taking anharmonic effects into account [6]. 
The upshot is that we can incorporate these through the substitution 9\ — > 9 2 .f(9 a ), where 

AV2 



I d9 \J cos 9 — cos 9 a , (36) 
Jo 



with f(9 a ) — > 1 as 9 a — >■ 0; it decreases monotonically to f(ir) ~ 0.516. In this regime, 
9 a —7- 7r, the adiabatic condition breaks down because the axion behaves like an inflaton, 
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and the scale factor a no longer varies slowly. However, analytic progress can be made in 
this limit if one takes into account that the above quantity needs to be combined with an 



estimate for the time when the axion actual 
over). This occurs no longer at m a « 3H 56 



y 



74 



starts rolling (and the inflationary phase is 
In the full numerical set-up, we always 



propagate the solution into the harmonic regime before we use (129 j) to extrapolate to today, 
and so the correction factor f(9 a ) is not required. 

To take the temperature dependence of g*(T) into account, we must solve the implicit 
equations (}3~Tj) and ( 132|) . We find that neglect of the temperature dependence of g* leads 
to an error of 10% in the analytic computation. On top of that the analytic computation 
assumes that the adiabatic regime is reached when m a = 3H; this is a further source of error 
relative to the full numerical result. 

Imposing the dark matter constraint Q c ~ 0.23, we get a relation between the two 
parameters f a an 9 a . The analytic approximation compares well with the full numerical 
result, except for very large or very small initial misalignment angles, see Fig. |6j At large 
angles the adiabatic condition breaks down. At small angles the dilute gas approximation 
(DGA) to the axion mass is constant whereas the full IILM mass decreases slowly towards 
m a (T = 0), i.e. the IILM dynamics starts rolling slightly earlier so that the Hubble dilution 
acts for longer which in turn leads to a smaller Q a at a given f a ; equivalently, to reach Q c a 
slightly larger f a is needed, as depicted in Fig. |6j 

If the PQ symmetry breaks spontaneously after inflation, the correlated domains with 
a given misalignment angle are not stretched to macroscopic sizes and a strong spatial 



dependence remains. In ref. 76], these fluctuations are averaged in the observable universe 
to find the root-mean-square fluctuations 9 a = -^=. This was then taken to be the initial 
condition for an estimate of the zero momentum mode axions. While this approach to 
axion production in the thermal scenario is flawed (as we shall discuss), it provides a useful 
benchmark with which to compare competing estimates. Adopting these initial conditions, 
from the full numerical results we obtain the important bound 

f a < 2.8(±2) x 10 n GeV or m a > 21(±2)/xeV. (37) 

This canonical result can be compared directly with our analytic modelling, as well as other 
estimates in the literature, to check accuracy. 

In Fig. [71 the errors of the analytic results with the DGA axion masses are compared 
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FIG. 6: The anthropic axion is defined, through its relation between f a and a given a fixed tt a . We 
display here the result for the case that axions form the dominant dark matter component of the 
universe, i.e. Q a = 0.23. The short-dashed lines correspond to the uncertainties in f a (0 a ) from the 
systematic errors in A, which is the dominant source of uncertainties. We also include the result of 
the analytic computation (|33p . Over many orders of magnitude the agreement is very good. More 
pronounced differences only show up at 8 a — > and 6 a — > vr. The latter is due to the fact that the 
adiabatic condition is not fulfilled because the potential becomes very flat and acts like a source of 
inflation, i.e. a rapidly changing scale factor. The differences between the analytic and numerical 
data at small 9 a follow from the different functional form of the axion masses: in the former case 
the axion mass is constant whereas in the latter it is slightly rising with temperature (see main 
text). 

to the numerical result across the full range of f a . The numerical solution has f a and 6 a 
chosen such that fl a = 0.23. Except at large and small f a , the differences with the analytic 
models using the same parameters are of order 0(1). It is clear in this regime that the 
relative abundance is not strongly dependent on the exact shape of the axion mass. We also 
compared the full numerical results for the DGA masses and found again that differences are 
only pronounced in the region of the QCD phase transition where the different mass ansatze 
differ considerably. We checked against the full numerical solution for the lattice-inspired 
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mass function too, see Fig. El and found less than 5% variations for f a < 10 15 GeV. 

While revealing the regimes in which analytic estimates go astray, for the most part the 
results are in good agreement with this simple DGA treatment. It is encouraging to note 
that estimates of the axion density are relatively insensitive to the detailed nature of the 
axion mass function, affirming the validity of the previous literature. However, this does 
not mean that a simple treatment will automatically give agreement with (1371) ; this requires 
appropriate normalisation, updated parameter choices and a careful treatment of g*, as 
attested by the significant differences between quoted bounds. 



B. Anthropic window, isocurvature and fine-tuning bounds 

The discussion so far has been purely classical. In order to discuss the anthropic window, 
where we fine-tune 9 a at large and small /„, we need to take into account the quantum 
mechanical fluctuations of the axion field induced by inflation. Like any other massless field, 
the axion receives quantum mechanical fluctuations during the quasi de Sitter evolution of 
the early universe, i.e. = or in terms of the axion angle 

^ = £r ■ (38) 

Apart from the spatial averages, these quantum mechanical effects need also be taken into 
account in the coarse grained equations; they are dominant for the anthropic scenario where 
inflation has smoothed out the 'classical' inhomogeneities, and makes sense only if the PQ 
symmetry is broken before the end of inflation. The fluctuations in the massless axion 
field then lead to isocurvature perturbations in the cosmic microwave background radiation 
(CMBR). The ensuing constraints apply only if the PQ symmetry has not been restored 
after inflation; this could happen if the quantum mechanical fluctuations or the reheat 
temperature are too large, i.e. if /„ < max [-§^,7rh]- 

As mentioned previously, the fluctuations lead to an effective axion angle, Of 1 = a/ (0%) = 



(9a) 2 + 00 > an d will be used in the coarse grained evolution equations. It follows that the 
effective angle is bounded by the root-mean-square fluctuations 



We will follow refs 



13 



15 



42 



45 



to put constraints on the PQ scale f a and on the 



inflationary scale Hj. By definition, isocurvature perturbations do not change the energy 
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FIG. 7: To analyse the differences between the different determinations of the axion abundance, we 
compute £l a on a fixed set of {f a , 6 a } derived from the full numerical determination with the IILM 
axion mass, given that f2 a = f2 c . We see that the analytic results are off by more than a factor of 
2 in the regimes of small and large axion angles; for the case when inflation has not operated after 
PQ symmetry breaking, i.e. for f a < 2.8 x 10 11 GeV, we can see that the numerical and analytic 
results are different by a factor of 3 (and more if the axion is not the dominant dark matter 
component). For the main part of parameter space the discrepancy is smaller but systematically 
an underestimate. The full numerical data using the lattice inspired axion mass are very similar 
for most f a (by construction), and differ only for large f a , as might have been expected. It is 
noteworthy that the numerical determination runs into the proper IILM axion mass already for 
rather low / a 's before it extrapolates to today. 



density, i.e. 5p = 0. For a massless field such as the axion, fluctuations do not change 
the potential energy density. In addition we have assumed that the quantum mechanical 
fluctuations are small, i.e. f a > Hj so that the PQ symmetry is not restored, and the gradient 
energy density is negligible compared to the inflationary energy scale, for details see ref. 13]. 
Thus, inflationary axion fluctuations are indeed isocurvature which leads to 

Sp = = 5 p a + 6 Pi + 6 Pr ■ (40) 
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Spi _ 3 Sp r 
Pi 4 p r 

between the temperature fluctuation, i.e. — = 4^-, and the axion fluctuation 

ST _ p a Sn a 

T 3 Pi + 4 Pr n a ' 

It is customary to define the entropy perturbation 



Assuming that all other fields have adiabatic perturbations, i.e. — = we get a relation 



(41) 



Si ^ SjfH/s)) = 6n i _ 3 5T j (42) 
m/s rii T 

where s oc T 3 is the entropy density and rii the number density of particle species i. It is clear 
that for adiabatic perturbations Si = by definition. At the time the relevant perturbations 
are set, the universe is radiation dominated, and it follows from (j4T]) that the radiation 
perturbations are negligible with respect to axion fluctuations. The initial condition is thus 
given by S a = ^ and once this mode leaves the horizon it remains constant. 

The relevant scales cross back inside the horizon during matter domination, i.e. p r p a \ 
it then follows from ( )4T]) that 

'5T\ 6 n a 



- 



-S a , (43) 



Tj iso 15 n 

where we have added the Sachs- Wolfe contribution and Q m is the total matter abundance. 
The fraction of isocurvature to total temperature fluctuations has been constrained to [53| 



at 95% confidence level, and (<5T/T)j^J s w 1.1 x 10 -5 , where the sum is taken over the first 
few low-lying multipoles. 

For the large f a we are interested in, the axion dependence on the energy density is well 
approximated by p a oc 9^, where in this case 9 a is not the effective axion angle. Assuming a 
Gaussian distribution for the axion angle perturbation, we find that 

'^((Sr)}^^' (45) 

From this it follows that the isocurvature fraction is given by 

aa 25 ((5T/T)t t ) 9i 1 DJ 

which we can rewrite into a constraint equation for Hi: 



[&) - 2(eM \T«) + lk {BM) >a - (47) 
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All explicit numerical factors have been absorbed into 

a a = 0m2-((5T/T)l t )n 2 m « 4 x lO" 12 « 1 . (48) 

Of the two possible solutions, the larger one is in conflict with ( 1391) . so that the isocurvature 
constraint becomes 

y/a^n V®a 1T 6.310" 6 

Hi < —^—Oafa < - T —e a {f a )f a « — a (/a)/a , (49) 

_l 

where 9 a (f a ) follows from Fig. EJ Note that 9 a /fl a oc fl a 2 , so that for fixed /„ the bound 
becomes weaker if the axions make up only a fraction of the dark matter content of the 
universe. 

The dependence of the isocurvature bound on the axion mass is encoded in the function 
9 a {fa) for fixed Q a . From Fig. [7] we can already anticipate that the exact numerical result 
will not depend strongly on the axion mass. We checked explicitly that the dependence on 
the masses is rather small, 

2 9J a 4 

3 (9j a y™ 3 • 

In fact, these largest discrepancies occur around 9 a ~ O(10~ 3 ). For smaller angles the 
results converge, whereas for larger angles the differences are on the 10% level, driven by 
the different exponents with which the masses decay. 

Actually, (149]) is an implicit equation for Hi since the effective axion angle depends on 
it. However, in this regime the difference between 9 a and (9 a ) is negligible. To see this, we 
rewrite (l4~9l) in terms of (9 a ), and get 

i _ 



"^^H'-m) Mj if <'•>'•■ (50) 

This, in turn, can be used to estimate that a a (9 a ). In the anthropic regime the de- 
pendence of 9 a on Hi is totally negligible, and we can fine-tune the effective axion angle to 
9 a ^ (# a )(l + 10- 10 ). 

If we want to extend the analysis to all of the anthropic window, i.e. 9 a = 0(1), we need 
to take into account anharmonic effects. We are greatly helped by the fact that a a (9 a )\ 
it allows us to Taylor expand the true axion potential around (9 a ) and we find that 

m = sin 2 (g a )K a -<) + |cos 2 (g a )< 

K J (1 - cos(£ a »2 + \ co&{9 a )ai + (1 - cos(0 a )) cos(0 a )<(l - i<) ' 1 ) 
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where we expanded to fourth order, and we assume again that S6 a is Gaussian with mean 
zero. For small ag a <C (0 a ) <C 1 this goes over into fH5|) . For large misalignment angles the 
behaviour becomes rather different, and for (6 a ) — > tt we see that the entropy perturbation 



perturbation has to be small, the solution for <jg a in the anharmonic case will be much larger 
and the constraint on Hj consequently much weaker. The solution satisfies again <j a <C (# a ), 
and the approach is self-consistent. 

Even though the fluctuation is very small, the regime 9 a — > tt can only be achieved if 
Hj is further constrained, as we will now show. Fine-tuning in the effective axion angle 
is hindered at large Hj by quantum fluctuations. Assuming that (9 a ) = tt, we obtain the 
following bound on Hi 



where £ is defined by £ = tt — 6 a and encodes the degree of fine-tuning. It is clear then 
that for axions on the top of the potential, this bound supersedes the isocurvature bound. 
This leads to a further restriction on the allowed parameter space shown in Fig. [8] (bot- 
tom left). This cut-off provides an interesting boundary in parameter space suggesting that 
inflationary axions have a maximum possible mass of approximately m a < 1 meV. Infla- 
tionary scenarios usually consider small axion masses in the range m a < 10 /xeV, but we 
see here with anharmonic tuning that it is possible to have Q a = 0.23 with masses at and 
above that of the thermal dark matter axion (see below). Naturalness arguments tend to 
disfavour inflation models with a low energy scale, but we note that the weakening of the 
isocurvature constraint at 6 a ~ tt opens up the inflationary window by several orders of 
magnitude relative to naive expectations. It is possible to have these heavier axions with an 
inflation scale approaching H pa 10 9 GeV. The fact that two alternative scenarios - thermal 
and inflationary - can produce axions with masses m a = 0.1-1 meV might strengthen the 
case for experimental searches in this parameter regime. 

Note that although the parameter space is really three-dimensional, i.e. in (6 a ), fa and 
Hj, we only plot the H[-f a plane as these are the fundamental parameters, whereas (9 a ) is 
naturally seen as an 'environmental' feature of our location in the universe after inflation. 
Recall also that without inflation the causal patches with different (8 a ) stay microscopic all 
the way to today with 9 a — > -^=, so again the axion angle is not required as an extra pa- 
rameter. The anthropic window bounds can be weakened by choosing 6 a < 9 a (f a ), however, 



tends to (S%) —> \ a e a i n contrast to the (S%) — > 



Ao"fl for the harmonic case. Since the 
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FIG. 8: The allowed parameter space in the Hj-f a plane is plotted in white; the inflationary energy 
scale is defined by Ej = (Hjmpi/ y^vr/S) 1 / 2 . The green curve in the upper left corner follows from 
the isocurvature constraint (|5ip . when the axion is the dominant dark matter candidate; the dashed 
line corresponds to the (semi-) analytic computation (based on (|3i p - (|33p . taking fully into account 
the temperature dependence of <?*) together with (|49|) . i.e. the constraint for a harmonic potential. 
If axions provide only a fraction of the dark matter content of the universe, the bound becomes 
weaker. For lower f a , i.e. larg er ai the anharmonic effects become important and the bound on Hi 
weakens because anharmonic effects lead to smaller perturbations. For 9 a — > ir, the dependence of 
Hj on 6 a can no longer be neglected and leads to the black curve. The lower green curve gives the 



451]); beneath this 



lower bound for isocurvature production (very inefficient reheating is assumed 
curve, the axion angle is spatially varying (with root-mean-square fluctuation 6 a = ir/\/3). The 
cyan wedge is excluded as it would lead to too much dark matter from axion string radiation. The 
bound from the non-detection of gravitational waves, i.e. r < 0.22 53], leads to the upper bound 



on the inflationary scale Hj < 1.26 x 10 14 GeV. Finally, f a is bounded from below by astrophysical 
considerations, i.e. axion emission from stars; we use f a > 4 x 10 8 GeV, see 54] chapter 3. 



if the axion is to be the dominant dark matter candidate then the parameter space is truly 
2-dimensional and collapses to the Hj-f a plane. 

We have mentioned previously, that the natural axion angle to be used in the evolution 
equations is the effective axion angle that takes into account root-mean-square fluctuations. 
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A priori this entangles Hi and (9 a ). However, we have seen that for a large part of the 
anthropic window 9 a does not really depend on Hi. On the upper green curve in Fig. [HJ, 
that is if the axion is to be the dominant dark matter candidate, then f a and (9 a ) are in the 
one-to-one correspondence defined through Fig. Again, on the black curve in Fig. [5J, (9 a ) 
is very close to 7r and 9 a depends solely on Hi for axions that contribute Q a = Q c . 

If we allow the axion to contribute only a fraction of the dark matter content to the 
universe, the parameter space in the anthropic region becomes truly 3-dimensional. For 9 a < 
9 a {fa) the axion density drops, and smaller effective angles are in one-to-one correspondence 
with Q a < Q c for fixed f a . Note that the relation Q a = Q a (f a , H T , (9 a )) can be inverted 
and allows us to trade (9 a ) for Q a . In Fig. iwe plot the available parameter space in the 
anthropic window. 

It was somewhat surprising that f a {9 a ) varies very slowly as tt — 9 a — > 0; indeed in that 
regime the axion field behaves like an inflaton, and one might have expected that f a — > 
rather fast. This is in agreement with the earlier numerical work by 76] and analytic 



computations 
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80] • It follows from this that the axion potential is not flat enough to 



support a prolonged inflationary period. In this regime, the fine-tuning in 9 a to many digits 
is reminiscent of the fine-tuning for the couplings of the inflationary potential to produce 
sufficient e-folds. 



C. Axion strings 

For completeness, let us take a closer look at the "classic axion window", that is, the 
thermal scenario in which the universe reheats to temperatures above the PQ symmetry 
breaking scale, T > f a . There are a number of misconceptions in the literature about 
the importance of misalignment production of axions from this thermal state. At high 
temperature, the thermal axion distribution 9 a will fluctuate randomly in time and space 
around the circle — > 2ty. An rms average with (9) = n/V3 away from the minimum at 
9 a = is assumed to be the thermal initial condition for a misalignment zero momentum 
mode (1371) which begins to oscillate when the axion mass switches on. Unfortunately, this 
generically underestimates axion production in the thermal scenario because it does not 
quantitatively account for the full spectrum of axion momentum states which are excited by 
the time of the mass 'switch on'. 
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FIG. 9: The allowed parameter space in the anthropic window. The dark matter axion lives on 
the face pointing towards the Hj-f a plane. Although not as clearly visible as for the right plot, 
the projection of said face into the Hj—f a plane corresponds to the anthropic window displayed in 
Fig. [8l The shading is calibrated to the axion density; this is clear for the right plot but is also 
true for the left plot. We see that the parameter space does not depend sensitively on £l a in the 
range Q a £ [Q c , 0.1 fi c ]; for smaller densities Hj starts to grow rapidly and eventually we reach the 
regime (6 a ) <C <Jo a -C 1 where the isocurvature bound can no longer be fulfilled. This gives another 
bound in the anthropic window, although a rather uninteresting one since the axion density has 
become totally negligible at that point. 



Axion production in the thermal scenario is in fact dominated by radiation from axion 
strings which inevitably form via the Kibble mechanism j^] when the C/pq(1) symmetry 
breaks. These strings radiate axions during their scale invariant evolution on all subhorizon 
scales and then annihilate and disappear at axion mass switch on (as we will explain in 
more detail below). The important point is that axion strings at late times can effectively 
radiate low frequency axions in the range H < u> < m a (for f a <C 10 16 GeV). When the 
mass switches on, it is fairly straightforward to show that the resulting density of these non- 
relativistic axions inevitably exceeds those naively estimated from the zero momentum mode. 
This discussion follows the review given in ref. jllfiol. 12]. updating the string constraint using 
new data. Note that there has been a long and intermittent history to the study of axion 
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(or global) strings with numerical simulations performed by several groups [s[ 137I . 
While there is general agreement on what happens on microphysical scales, there has been a 
variety of different interpretations offered when extrapolated over many orders of mag nitude 



to cosmologicai scale, Here, we affi™ thebaic plot™ outUned originally in ref. while 
an alternative view can be found in ref. [73J], an interpretation for which an earlier critique 



was offered in ref. 



12|. 



Axion strings are global strings which possess strong long-range forces, with a (renor- 
malised) energy per unit length given by 

p « 27r/>(L/5) , (53) 

where 5 ~ j~ x is the string core width and the typical radius of curvature is L ~ t. At late 
times near axion mass switch on, the logarithm ln(L/<5) ~ 70 for f a ~ 10 11 GeV. Here, we 
essentially have a renormalisation of the bare string energy density po = by radially 
integrating out the effect of the axion field that winds by 2ir around the string. Despite 
the nomenclature, with such a large p ^> po, the axion string is in fact highly localised 
with more than 95% of its energy in only 0.1% of the volume through which it traverses; it 
behaves to lowest order like a (local) Nambu string. 

The evolution of a network of cosmic strings is non-pathological (whether local or global), 
because their evolution is scale-invariant with their curvature radius growing as L = yt and 
the string density scaling as p = (p/t 2 , that is, in proportion to the background cosmological 



density. In t 



re radiation era, we have C = 7 ~ 13, as determined by large-scale numerical 



simulations 3), [fjj]. The string network consists of both a population of long strings, that 
carry most of the energy, and small (subhorizon) loops which are created through long string 
reconnections, 

Pstr = Poo + Pi = -p + P / £n(£, t)d£ , (54) 

where n(£,t)d£ is the number density of loops in the range i to £ + d£ at the time t. By 
conservation of energy for the string network, one can calculate the loop number density 
(see the discussion in e.g. ref [z^) 1 

Call - (v 2 )Wl 2 
^)d£= Q9 \J t Jr , (55) 

where a describes the typical loop size at creation £ = at, the rms string velocity is (v 2 ) 1 ^ 2 ~ 
0.65, and the relativistic boost factor g w l/y/2 accounts for centre-of-mass kinetic energies 
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at loop creation (with Uq = g(v 2 ) ~ 0.28 reliably measured in simulations). Significant 
uncertainty remains concerning the loop creation size a given the complex nature of small 
scale structure on strings and the limited dynamic range available in simulations. The most 
recent and largest scale simulations indicate that the largest loops are produced on length 
scales a « 0.1 and below, but with a fairly flat loop production function which extends 



down to smaller scales 



63|. 



Loops oscillate periodically and decay fairly rapidly into axions. Axion radiation is pri- 
marily emitted in low frequencies, that is, in the lowest harmonics of the fundamental 
frequency of the loop oscillation uq = Att/L (the loop period is T = L/2). We note that 
axion radiation by strings can be treated very similarly to radiation into gravitational waves 
[79! - Decomposing the loop radiation power P per oscillation into a spectrum P n for each 
harmonic nuo we expect 

P = p n , P n oc n~ q (n > 1), with q > 4/3 . (56) 

n 

Here, the spectral index q = 4/3 can be calculated analytically for loops with cusps, but 
realistically this is expected to be greater than 4/3 because of radiative backreaction, with 
an effective maximum n*. Given the dominance of the low harmonics in these spectra, the 
following results are relatively insensitive to the details at large n. The typical integrated 
power per oscillation is described by T a , defined in the continuum limit with a radiation 
spectrum g(£u) as 

P = r a f 2 a = fl J g{x)dx with = fj g{£u) . (57) 

The typical loop radiation rate T a can be estimated analytically for specific loop trajectories 
(see, for example, ref. [lj]), but it is measured numerically from simulation loop trajectories 
to be T a w 65 Q. 

Due to these radiative losses into axions, a loop will shrink linearly from its original size 
at creation t\ = at- x as 

£ = 4-«(t-ti) with k = Tjfi w r a /27r/ a 2 \n(£/5) . (58) 

Given ln(£/S) ~ 70 for the energy scales and times of interest, this means that the loop 
backreaction rate k ~ 0.15 and a loop will oscillate about 10-15 times before vanishing. 
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This loop decay will modify and cut-off the loop distribution given above (|55|) . becoming 

Cz/ « 1/2 (1 + ^/«) 3/2 



n{£,t)d£ 



(59) 



{£ + ntflH^I 2 ' 

Given the spectral assumptions ( 1571) . we can integrate over the loop distribution [59] to obtain 
a spectrum for the number density of axions n a (for a < k) 12] 



dn n 



1 dp a 4r o <tW /2 (l + x-laf' 2 



1 + H 



-3/2' 



(60) 



du u du 3u 2 K 3 / 2 t 2 
Integrating down to the lowest frequencies u = 4n/at emitted at a time t, we obtain the 
total axion number density 



Tq(>0 

3nt 



1 + 



a\3/2 



(61) 



where the prefactor has a numerical value r£i/o/37r f» 31 with moderate uncertainties 
(±30%). The most important uncertainty in the expression flBTl) is clearly the loop size 
parameter a measured relative to the backreaction rate k. In Fig. [TO], we see the strong 
dependence of the axion string bound on the ratio ol/k having imposed the dark matter 
constraint fl a < 0.23. Recent string simulations suggest a < 0.1 implying ol/k < 0.7, but 
what is the lower limit or, rather, the appropriate range for a? 

The lower cutoff for the loop production scale a depends on the nature of small-scale 
structure on long strings, since it is unlikely that loops can be produced on scales below 
which the string network becomes smooth. Numerical and analytic studies of long string 
backreaction indicate that it is somewhat weaker than loop backreaction because of geo- 
metric effects and the typical amplitude and velocity of long string oscillations. The loop 
radiation rate k is then replaced by the long string rate 11 | 



7T 



too ~ — hi(t/5) 



0.02 



(62) 



(refer also to related studies of gravitational waves from long strings in ref. |62|). The 
expression (j6"2|) indicates a lower limit on the loop production size £ > K^t, thus with the 
loop size ratio lying in a fairly narrow range 0.1 < ol/k < 0.7. Nevertheless, it is the larger 
loops with ol/k ~ 0.5 which are expected to dominate the axion contribution, given the 
nature of the spectral weighting underlying f lBT]) . 



There is also a significant contribution coming 



which, given ([62]) . has a spectral radiation rate 

dn™ 1 dp a 



11 



rom direct radiation from long strings 



12| 



du u du Rk^uH 2 



(63) 
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FIG. 10: Effect of the loop creation ratio r = a/n on the dark matter axion constraint. If a(t) 
the loop creation size at time t is larger than K(t), the loop radiation backreaction scale, then the 
constraint is stronger and conversely for a < k. Note that in the second case with a <C k, the 
dominant contribution arises from direct long string radiation, which again exceeds misalignment 
production. 



This integrates to produce the additional axion number density 

7T 2 fV 

oo = ( 64 ) 
32t K J 

where we have assumed that the radiation spectrum is peaked at the backreaction scale 
u> fa ATi/noot (second harmonic). This assumption is certainly a conservative underestimate 
because there will be significant radiation from the strings on the correlation length and 
above, up to the horizon scale u > H, i.e. effectively contributing more non-relativistic 
axions at mass 'switch on'. 

Taken together, the sum of the axions produced by loops and long strings is shown 
in Fig. [10], indicating that this is a significant stronger constraint than the misalignment 
estimate even if loops were very small a/ft C 0. Given that present numerical simulations 
indicate that a significant proportion of loops are produced on the largest scales in the 
available range 0.1 < a/n < 0.7, we take the effective value a/n = 0.5 ± 0.2 to obtain an 
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updated axion string constraint 



f a < 3.21* x 10 iU GeV, m a > 0.20^ meV, (65) 

that is, we predict that if thermal axions are the predominant dark matter then they will 
lave a mass near m a w 200 fieV (revising slightly upward previous estimates from strings 



12J). We emphasise that the axion string constraint (1651) is a conservative bound which is 
an order of magnitude stronger than the misalignment estimate ( l37lh 

The axion string contribution is computed around the period of mass 'switch on', defined 
by m a m 3H. This induces a dependence on the axion mass. It turns out that the differences 
are fairly small, i.e. on the 1% level. Given the large uncertainties in the axion string 
computation, the axion mass dependence is certainly negligible. 

Finally, we comment on additional contributions, uncertainties and alternative views of 
the thermal scenario. At the QCD phase transition, the tilting axion potential causes the 
axion field 9 to relax toward the minimum 9 = 0, assisted on long wavelengths (u ~ H) 
by Hubble damping - as for the zero momentum mode in inflationary scenarios. However, 
the presence of a string implies a topological obstruction to this relaxation, so the field 
instead localises its variations — > 2n into domain walls connecting strings to others of the 
opposite orientation 7l|, [78j. This correlation of strings within the network, as well as the 



intercommuting properties of strings colliding wit 



hybrid network as demonstrated numerically 
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i walls, leads to the rapid demise of the 



69(. Self-intersections of loops bounding 



domain walls are inevitable until the system breaks up into tiny loops i < m~ l and wall 
tension effects become negligible. These loops can decay by radiating (massive) axions and 
gravitational waves. Estimates of the axion number density n„ w produced by this process 
are crude but suggest a contribution comparable only to that from misalignment [18]. Axion 
production through hybrid network formation deserves more detailed analysis particularly 
for nonrelativistic modes with H < u < m a . 

The key uncertainty in the string constraint above remains the typical loop production 
size a for a global string network. This is difficult to probe numerically for two reasons. 
First, Nambu string simulations are progressing in resolution but they do not at present 
include the realistic radiative backreaction necessary for describing global strings. The 
understanding of a is improving but how it cuts off on small scales must be estimated 
analytically. Secondly, alternative field theory simulations do not have the dynamic range 
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needed to address the loop production issue; with \n(t/5) ~ 3 70, simulated global strings 
remain in a strongly damped regime unlike cosmological axion strings. It has been suggested 
that the spectrum of loop and long string radiation could be 'flat' (see, for example, [3| 
and references therein), rather than dominated by the lowest harmonics as in the standard 
picture presented above (157)) . The proposed 'flat' spectrum entails producing equal radiation 
power over many orders of magnitude t < uj < f a (up to 30), effectively suppressing the 
importance of the long wavelength modes on which the bound (165)) is based. The 'flat' 
spectrum yields an axion string constraint roughly matching the misalignment bound ( 157)) 



37J, but a detailed critique of this scenario is offered elsewhere |l2 |. 



V. CONCLUSION 



We have presented a temperature-dependent axion mass, based on instanton methods, 
that is valid for all temperatures. The transition between the high- and low-temperature 
regime is well-motivated and computed within the same model, the IILM, in contrast to 
some ad hoc procedure to connect the two. 

Although the IILM does not explain confinement, chiral symmetry restoration is incorpo- 
rated and the model can be expected to give qualitatively correct results for the axion mass; 
this relies on the fact that it is related to the QCD topological susceptibility which in turn 
is a chiral quantity. We note that chiral symmetry restoration is indeed seen in the IILM, 
although at a slightly lower temperature. Given the discovery of the more general KvBLL 
calorons, that may play an important role in the confinement/deconfinement transition, we 
expect to improve our understanding of the axion potential in the future by incorporating 
these new degrees of freedom into the IILM. 

Using this new axion mass, we solved numerically the axion evolution equations in the 
concordance FRW cosmology. It turns out that the analytic approximations used previously 
differ by a factor of 2 — 3. This is unexpectedly good agreement, considering the crude 
determination of the axion mass within the dilute gas approximation. We believe it to 
be the result of a coincidence, that the extrapolation of the high temperature DGA axion 
mass fairly closely follows the full IILM result around the phase transition. Conversely, this 
correspondence can be interpreted as evidence that the axion mass determination is fairly 
robust. This is also seen from the rather small differences between the numerical results 



34 



between the IILM mass and the lattice inspired mass. 

We want to draw to attention that the IILM is a model of QCD, and as such it needs 
to be checked against lattice data, say. In that light, there remains the possibility that the 
true high temperature axion mass is different from the IILM prediction. This could lead 
to qualitatively different results: On the one hand, a softer decay, as seen in gluodynamics, 
will lead to weaker constraints. A more abrupt mass switch on, on the other hand, would 
tighten the constraints and potentially close the classic axion window. The ideas of molecule 
formation within the IILM, and the subsequent stronger suppression of the axion mass in 
the plasma phase, have initially prompted this investigation. Within the current IILM this 
is not realised, but it is not ruled out either. The lattice community is performing realistic 
QCD simulations directly at the physical quark masses, and we can expect a reliable axion 
mass determination to follow from that data in future. 

To get an accurate estimate across the whole f a axis, we included the correct temperature 
dependence between the scale factor and the plasma temperature which follows from the 
conservation of entropy. To that end we computed the full phase-space integral to get the 
lemperature dependence for the effective degrees of freedom g*.s and g* t R, following closely 



201 ] . Additionally, we provide accurate fitting formulas, which to our knowledge have not 



been presented in the literature previously. 

In the classic axion window, where the PQ symmetry breaks only after inflation, a quanti- 
tative analysis of the misalignment bound yields f a < 2.8(±2) x I0 11 GeV, m a > 21(±2) /zeV. 
While the misalignment axion is a useful benchmark for comparing alternative estimates, it 
is far exceeded in density by axions from string radiation which yields the more stringent 
string bound f a < 3.2^ x 10 10 GeV. Experimental searches for a thermal dark matter 
axion should focus on masses around m a ~ 200 fieV. 

The anthropic axion window, which entangles 9 a and f a , is constrained by investigating 
the production of isocurvature perturbations. The rather small contribution of these to the 
CMBR power-spectrum places strong bounds on f a and the inflationary scale Hj. This 
bound is strong enough so that quantum fluctuations are totally negligible, i.e. a a <C (9 a ), 
for almost all axion angles. The anthropic window allows a dark matter axion that can have 
any initial misalignment angle, provided the inflationary scale is low enough. In light of 
naturalness in fundamental theory, most interest has focused on the constraints for large f a . 

Nevertheless, taking the whole of the anthropic range seriously reveals some interesting 
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possibilities. In particular, we investigated the region with large misalignment angles, espe- 
cially 6 a —f 7r. In this regime the axion potential can no longer be described by a parabola, 
and we need to take the anharmonic effects into account. A self-consistent solution follows 
for the regime with small fluctuations, in which case we can Taylor-expand the axion poten- 
tial around {0 a ); the anharmonic effects are then encoded in the anharmonic dependence on 
{6 a ). These effects lead to smaller isocurvature perturbations as compared to the harmonic 
case and, consequently, lead to weaker constraints on the inflationary scale. 

Fine-tuning the initial misalignment angle to n, we find that the quantum fluctuations 
must be even more stringently constrained. If the axion provides the dominant component 
to the dark matter content of the universe and if we take at face value an inflationary period 
after the spontaneous breaking of the PQ symmetry, then this places the strongest constraint 
on f a and Hj at large initial misalignment angle. We note the intriguing possibility of a 
dominant dark matter axion with a mass m a ~ 200 /ieV which is consistent with either the 
thermal or the inflationary scenarios. This model independence provides extra motivation 
for experimental searches around this mass range. Anthropic tuning near 6 ~ n allows 
inflationary dark matter axions (Q a = 0.23) to have masses as high as m a < 1 meV, but no 
higher because quantum fluctuations restrict the fine tuning (for Hj > 10 4 GeV). 

We note that the isocurvature and quantum fluctuation constraints become weaker if the 
axion is not the dominant dark matter candidate, and we displayed the ensuing 3-dimensional 
parameter space. 

Finally, the dependence of the cosmological constraints on the axion mass is only a 
secondary effect for the isocurvature constraint and the axion string contribution. In the 
former case the examined parameter space is so large that only significant modifications 
play a role, such as the change from a harmonic to an anharmonic potental; in the latter 
case, the uncertainties inherent in the computation easily exceed those from the axion mass 
dependence. 
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Appendix A: Effective degrees of freedom 

The entropy and radiation density is well approximated by counting only the relativistic 
degrees of freedom. When the temperature of the plasma drops below the mass, the particle's 
contribution to the entropy and radiation density drops to zero fairly rapidly. To compute 
these threshold effects correctly, the relevant phase-space integrals have to be evaluated, 
which is not possible in closed form in general. The effective (relativistic) degrees of freedom 
are defined by factoring out the contribution from a single massless degree of freedom, of 
temperature T, from the phase space integrals; this leads to the expression (I2"lj) and (}2TS|) . 
Since the photon field will be the only relativistic field at sufficiently low temperatures, it is 
used to set the temperature of the plasma, i.e. T = T 7 . 

If a species decouples, it will no longer be in contact with the heat bath, and its tempera- 
ture will simply redshift due to the Hubble expansion. This is in contrast to the evolution of 
the plasma temperature which follows from entropy conservation. Thus, if a species becomes 
non-relativistic, it transfers its entropy only to those particles that are still in equilibrium 
with the plasma, and reheats the plasma since the number of effective degrees of freedom 
has decreased. This mechanism leads to the different temperatures % for the decoupled 
fields. 

In standard cosmology this happens to the neutrinos which decouple before e - 
annihilation, and so have a slightly lower temperature than the photons, T v = (^-) 1 ^ 3 T 7 ; 
this result is valid at T 1 MeV. For a general temperature T, the neutrino temperature 
is given by 



where Tf; ph 1 MeV is the neutrino decoupling temperature. It is a consequence of the fact 
that for decoupled (relativistic) particles such as neutrinos T*/T/ = af/a^ where the ratio 
of the scale factors follows from the adiabatic evolution of the universe. In fact, (1A1I) is 
an implicit equation in T v since y*,g(T) depends on it. With only neutrinos decoupling, it 
is easy to solve, and the result is flAlj) with the substitution g^g — > g* s — g v . In order to 




(Al) 
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reproduce the correct analytic ratio for low temperature, we have set T„ = 5 MeV. This 
then leads to Fig. [51 

Evaluation of the exact numerical integration is fast but too slow for use in the system 
of ODE's that needs to be solved for the axion dynamics. We have approximated the exact 
result by fits that are sums of smoothed out step functions in log-log space. These fits are 
plotted in Fig. [5] and are generically accurate below the 1% level, except at the QCD phase 
transition and the e ± -annihilation where the accuracy is only around 4%. The fits are given 
by 



3=1 

The corresponding parameters are 
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